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FULLY LAZY LINKING WITH MODULE-BY- An advantage of linking performed at run time, that is, 

MODULE VERIFICATION dynamic linking when the program is being executed, is that 

modules not used during execution need not be linked, thus 

CROSS REFERENCE TO RELATED reducing the number of operations that must be executed and 

APPLICATIONS 5 likely reducing the size of the executing code. In general, 

Th* apphcation is related to U.S patent application Ser. ^g^gfg^ng Unked. The deferred linking of mod- 

N °^! 5 ' 2 ?L filed ° eC - 24 199 ^J elhn i^ ° 0Sl " 8 '^ 1 ^^ «3£ until the module is needed allows a deferral in loading 

B ^^^^^J^^^^^^! 'hose modules as well, which is called lazy loading. 
AND METHOD WITH PRE- VERIFICATION OF DATA , . . u ... , ' , .? 

TYPE RESTRICTIONS AND OBJECT INITIALIZATION, 10 k " » P™*nt. when assembling several modules ftat may 

now U.S. Pat. No. 5,740,441; U.S. paten, application Ser. hav ° been wntten mdependently to check both that each 

No. 09/134,477 filed Aug. 14, 1998, Bracha and Liang, mo *" e P erfo " ns w, ' bu l ,ts ? wn h four c ° r ° ers ' 

entitled. METHODS AND APPARATUS FOR TYPE w,,h '"tra-module check* and also that the modules work 

SAFE, LAZY, USER-DEFINED CLASS LOADING; the „ P ro P er 'y t0 S etbei ; i e - with inter-module checks. By analogy 

disclosures of which are incorporated herein in their entire- 15 w,,h ,he tefninology used by the designers of the JAVA™ 

ties bv reference programming language, this^post^compilation module 

1 " . , „ . checking .can be called verification. 

This application is also related to U.S. patcot application < - . ' . . . - . 

Ser. No. 09/321,223 filed May 27, 1999, entitled FULLY A ^ cxam P* c of a computer architecmre^t benefits from 
LAZY LINKING; U.S. patent application Ser. No. 09/320, 20 lmkm S is a virtual machine (VM) such as the 

574 filed May 27, 1999, entitled MODULE-BY-MODULE J * VA ™ virtual machine (JVM) of Sun Microsystems, Inc., 

VERIFICATION; U.S. patent application Ser. No. 09/320, wh * h 15 a ° at * tracl computer aremtecure that can be 

581 filed May 27, 1999, entitled CACHING UNTRUSTED implemented in hardware or software Either implementa- 

MODULES FOR MODULE-BY-MODULE VERIFICA- U f on l ^! tended t0 be 1DCluded in the f ° Q ° Wmg descn P tl0ns 

TION; U.S. patent application Ser. No. 09/321,228 filed 25 ot a VM " . 
May 27, 1999, entitled DATAFLOW ALGORITHM FOR A VM can provide platform independence in the follow- 

SYMBOLIC COMPUTATION OF LOWEST UPPER ing manner. Statements expressed in a high level computing 

BOUND TYPE language, such as the JAVA™ programming language, are 

compiled into VM instructions that are system independent. 

FIELD OF THE INVENTION 30 The VM instructions are to the VM what machine code is to 

a central processing unit (CPU). The VM instructions can 

This invention generally relates to computer program- men be transferred from one machine to another. Each 
ming languages, and more particularly to computer pro- different processor needs its own implementation of a VM. 
gramming languages with dynamic linking that verify tne vm instructions by translating or inter- 
instructions while supporting lazy loading. prcting the VM instructions one or more instructions at a 

„ „ _ T , ^ time. In many implementations, the VM implementation is 

DESCRIPTION OF RELATED ART a progfam ^ Qin ^ on lhe CPU of a particular oom^ but 

In general, computer programs are written as source code the VM instructions may also be used as the native instruc- 

statements in a high level language which is easy for a tion set of a particular processor or device. In the latter case, 

human being to understand. As the computer programs are 40 the VM is an "actual" machine. Other operations can also be 

actually executed, a computer responds to machine code, performed by the VM including dynamic Linking and veri- 

which consists of instructions comprised of binary signals fication. 

that directly control the operation of a central processing The process of programming using such a VM then has 
unit (CPU). It is well known in the art to use a special two time epochs associated with it; "compile time" refers to 
.program^called a .compiler to-- re ad the source code and to, 45 the steps which convert the high level language into the VM 
conyerijts "statements into, the machine code instructions,p{ instructions, and "run time" refers to the steps which in a 
the specific CPU. The machine code instructions thus pro- JAVA™ VM environment, interpret instructions to execute 
duced are platform dependent, that is, different computer the module. Between compile time and run time, the mod- 
devices have different CPUs with different instruction sets ules of instructions compiled from statements can reside 
indicated by different machine codes. 50 dormant for extended, arbitrary periods of time, or can be 

It is also known in the art to construct more powerful transferred from one storage device to another, including 

programs by combining several simpler programs. This being transferred across a network, 
combination can be made by copying segments of source The problems encountered in trying to implement 

code together before compiling and then compiling the dynamic linking with verification and with or without lazy 

combined source. When a segment of source code state- 55 loading can be illustrated for the example of the JAVA™ 

ments is frequently used without changes it is often prefer- virtual machine. The JVM is a particular VM for the object 

able to compile it once, by itself, to produce a module, and oriented JAVA™ high level programming language that is 

to combine the module with other modules only when that designed to perform dynamic linking, verification and lazy 

functionality is actually needed. This combining of modules loading as described for the conventional JVM in The 

after compilation is called linking. When the decision on 60 JAVA™ Virtual Machine Specification, by T. Lindholm and 

which modules to combine depends on run time conditions Frank Yellin, Addison-Wesley, Menlo Park, Calif., 1997. 
and the combination of the modules happens at run time, just Object oriented programming techniques such as those 

before execution, the Linking is called dynamic linking. used by the JAVA™ platform are widely used. The basic unit 

An advantage of linking is that programs can be devel- of object oriented programs is the object which has methods 

oped a module at a lime and productivity can be enhanced 65 (procedures) and fields (data), herein called members, 

as different developers work, possibly at different sites, Objects that share members are grouped into classes. A class 

simultaneously on separate modules. defines the shared members of the objects in the class. Each 



05/10/2004, EAST Version: 1.4.1 



US 6,601,114 Bl 



object then is a particular instance of the class to which it 
belongs. In practice, a class is often used as a template to 
create multiple objects (multiple instances) with similar 
features. 

One property of classes is encapsulation, which describes 5 
the property that the actual implementation of the members 
within the class are hidden from an outside user, and other 
classes, except as exposed by an interface. This makes 
classes suitable for distributed development, for example by 
different developers at different sites on a network. A com- 10 
plete program can be formed by assembling the classes that 
are needed, linking them together, and executing the result- 
ing program. 

Classes enjoy the property of inheritance. Inheritance is a 
mechanism that enables one class to inherit all of the 15 
members of another class. The class that inherits from 
another class is called a subclass; the class that provides the 
attributes is the superclass. Symbolically, this can be written 
as subclass<=superclass, or superclass«>subclass. The sub- 
class can extend the capabilities of the superclass by adding 20 
additional members. The subclass can override an attribute 
of the superclass by providing a substitute member with the 
same name and type. 

The JVM operates on a particular binary format for the 25 
compiled classes — the class file format. A class file contains 
JVM instructions and a symbol table, as well as other 
ancillary information. For the sake of security, the JVM 
imposes strong format and structural constraints on the 
instructions in a class file. In particular example, JVM 3Q 
instructions are type specific, intended to operate on oper- 
ands that are of a given type as explained below. Similar 
constraints could be imposed by any VM. Any language 
with functionality that can be expressed in terms of a valid 
class file can be hosted by the JVM. The class file is 35 
designed to handle object oriented structures that can rep- 
resent programs written in the JAVA™ programming 
language, but may also support several other programming 
languages. 

In the class file, a variable is a storage location that has 40 
associated a type, sometimes called its compile-time type, 
that is either a primitive type or a reference type. The 
reference types are pointers to objects or a special null 
reference which refers to no object. The type of a subclass 
is said to be a subtype of its superclass. The primitive types 45 
for the WM include boolean (taking the truth values true and 
false), char (code for a Unicode character), byte (signed 
eight bits of 0 or 1), short (signed short integer), int (signed 
integer), long (signed long integer), float (single-precision 
floating point number) or double (double precision floating 50 
point number). 

The members of a class type are fields and methods; these 
include members inherited from the superclass. The class 
file also names the superclass. A member can be public, 
which means that it can be accessed by members of any 55 
class. A private member may be accessed only by members 
of the class that contains its declaration. A protected member 
may be accessed by members of the declaring class or from 
anywhere in the package in which it is declared. In the 
JAVA™ programming language, classes can be grouped and go 
the group can be named; the named group of classes is a 
package. The actual instructions for the JVM are contained 
within methods of the class encoded by the class file. 

When a JAVA™ language program violates constraints of 
an operation, the JVM detects an invalid condition and 65 
signals this error to the program as an exception. An 
exception is said to be thrown from the point where it 



occurred and it is said to be caught at the point to which 
control is transferred. Every exception is represented by an 
instance of the class Throwable or one of its subclasses; such 
an object can be used to carry information from the point at 
which an exception occurs to part of the program, an 
exception handler, that catches it and deals with it. 

The JVM starts execution by invoking the method "main" 
of some specified class, passing it a single argument which 
is an array of strings. This causes the specified class to be 
loaded, linked and initialized. 

Loading refers to the process of finding the binary form of 
a class or package with a particular name, typically by 
retrieving a binary representation previously compiled from 
source code. In the JVM, the loading step retrieves the class 
file representing the desired class. The loading process is 
implemented by the bootstrap class loader or a user defined 
class loader. A user-defined class loader is itself defined by 
a class. A class loader may indicate a particular sequence of 
locations to search in order to find the class file representing 
a named class. A class loader may cache binary representa- 
tions of classes, pre-fetching based on expected usage, or 
load a group of related classes together. The more classes 
that are pre-fetched or group loaded the more "eager" is the 
loader. A "lazy" loader pre-fetches or groups as few classes 
as possible. The conventional JVM specification permits a 
broad spectrum of loading behaviors between eager and 
almost fully lazy. 

A VM is fully lazy if it calls a class loader to load a class 
only at the time that the class is first necessary to execute an 
instruction of a class currently being processed. Fully, lazy 
loading, if achieved, does not waste run time resources, such 
as system memory and execution time, loading classes that 
are not strictly required at run time. 

Linking in the JVM is the process of taking a binary form 
of a class in memory and combining it into the run time state 
of a VM, so that it can be executed. A class must be loaded 
before it can be linked. Three different activities are 
involved in linking according to the JVM spec: verification, 
preparation and resolution of symbolic references. 

During verification, necessary constraints on a binary 
class in the class file format are checked. Doing so is 
fundamental to the security provisioas of the JVM. Verifi- 
cation ensures that illegal operations are not attempted by 
the JVM that can lead to meaningless results or that can 
compromise the integrity of the operating system, the file 
system, or the JVM itself. However, checking these con- 
straints sometimes requires knowledge of subtyping rela- 
tions among other classes; so successful verification typi- 
cally depends on the properties of other classes referenced 
by the class being verified. This has the effect of making the 
current JVM design specification for verification context 
sensitive. 

The binary classes of the JVM are essentially exemplars 
of general program modules that contain instructions pro- 
duced from compiled source statements. Context sensitivity 
of validity checks means that those checks depend on 
information spread across more than one module, i.e., those 
checks are called cross-module checks or inter-module 
checks herein. Validity checks that do not require informa- 
tion from another module are called intra-module checks 
herein. 

Context sensitive verification has some disadvantages. 
For example in an object oriented programming system like 
the JAVA™ platform, it leads to a verifier initiating class 
loading when the verifier needs to check subtype relations 
among classes not already loaded. Such loading can occur 
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even if the code referencing the other classes is not ever 
executed. That is, context sensitive verification can interfere 
with fully lazy loading. Because of this, loading can con- 
sume memory and slow execution at run time compared to 
a process that does not load the classes unless they are 5 
referenced by the instructions that are actually executed. 

When verification is context sensitive there is also no 
provision for verifying one class or module at a time before 
run time. This is a disadvantage because classes cannot be 
verified ahead of time, e.g. before run time, so verification *° 
must incur a run time cost. Thus there is a need for 
module-by-module, also called module-at-a-time, verifica- 
tion before run time. Such verification is herein called 
pre-verification because technically it is distinct from the 
verification which occurs during run time linking by the is 
JVM. 

Also, since verification is performed at run time, a class 
that has been run once, and passed verification, is subjected 
to verification again each time the class is loaded — even if 
the class is being used in the same application on the same 20 
host computer, where no new verification issues are likely or 
where a situation can be arranged such that no changes that 
would affect verification can be made. This can lead to 
redundant verification, thereby requiring more memory and 
executing more slowly during run time than ought to be 25 
necessary. Thus there is a need for an option to use pre- 
verified modules without further, or with minimum, verifi- 
cation at run time. 

The needs for pre-verification and fully lazy loading are 3Q 
separate needs that might be met separately. There is also a 
need for supporting module-by-module pre-verification 
along with fully lazy loading. 

The need for pre-verification, including reduction of run 
time verification, may conflict with the goals of security that 35 
require all modules supplied to a virtual machine or any 
computing architecture be checked at run time to prevent 
illegal or damaging operations. For example, in an untrusted 
situation, such as downloading a module and its pre- 
verification output from the Internet, an attacker may be able ^ 
to spoof the pre-verification output — possibly making a 
malignant class appear benign. Thus, there is a need for 
pre-verification that is usable in untrusted situations, as in 
downloading modules across the Internet. 

Users can determine the presence of modules in a reliable 45 
and simple way. For example, the user can avoid 
linkage errors due to calls to modules missing on a 
different version of a run time environment by placing 
those references on a program branch that is not 
executed unless the different version is available. 50 
The breadth of loading behaviors of the conventional JVM 
specification does not permit these advantages. 

It is another object of the present invention to provide 
one- module-at-a-time pre-verification. It is also an object of 
the present invention to utilize pre-verified instructions to 55 
reduce run time verification. Some users of the JAVA™ 
platform would want to perform context insensitive, or 
context independent, verification checks on some classes. 
There are a number of advantages to context independent 
checking which can be performed during or after compila- 60 
tion and before run time. The advantages include: 

Some verification errors can be detected before run time; 

The linking component of run time if one is still required, 
is smaller and simpler because the amount of verifica- 
tion code it contains is reduced; and 65 

The user can store modules (in a secured repository, for 
example, a RDBMS (relational database management 
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system) on a module-by-module basis rather than appli- 
cation by application, and do as much work as possible 
before of run time. This obviates redundant verification 
and reduces or eliminates run time costs of verification. 
It is another object of the present invention to combine 
one-module (or class)-at-a-time pre-verification with run 
time verification that permits fully lazy loading, in order to 
enjoy the benefits of both at the same time. 

It is another object of the present invention to utilize a 
substitute for a LUB when full knowledge of the type lattice 
is lacking to simplify inter-module validity checks. 

These and other objects and advantages of the present 
invention are provided by a method, computer program, 
signal transmission and apparatus for verifying instructions 
in a module of a computer program during linking using 
pre-verification constraints with fully lazy loading. It is first 
determined whether a first module which is loaded has 
passed verification one-module-at-a-time before linking. If 
the first module has passed verification, a pre-verification 
constraint on a constrained module is read, if any. It is then 
determined if the constrained module is loaded, if any 
pre-verification constraint is read. If the constrained module 
is not already loaded, the pre-verification constraint is 
retained as a verification constraint. 

In another aspect of the invention a pre-verification sys- 
tem includes a network and a computer readable storage 
medium connected to the network for storing a module of a 
computer program. A memory into which a module may be 
loaded is also connected to the network. A processor is 
connected to the network, which is configured to determine 
before linking whether checking an instruction in a first 
module which is loaded requires information in a referenced 
module different than the first module. A constraint for the 
referenced module is written without loading the referenced 
module if the information is required. This way, verification 
is performed one module at a time. Then the same or a 
different processor connected to the network is configured to 
determine during linking whether a first module which is 
loaded has passed verification one-module-at-a-time before 
linking. A pre-verification constraint on a constrained 
module, if any, is read if the first module has passed 
verification. It is then determined if the constrained module 
is loaded, if any pre-verification constraint is read. The 
pre-verification constraint is retained as a verification con- 
straint if the constrained module is not already loaded. In 
this way verification is performed one-module. 

The need for fully lazy loading or module-by-module 
pre-verification engenders a need for a substitute represen- 
tation of a type lattice. A type lattice is a mathematical 
structure expressing subtyping relationships among types. A 
representation of a type lattice is built by the JVM for 
indicating the types and subtypes of classes during run time. 
The JVM also maintains references and types of all the 
attributes of the classes that are being linked. Similar run 
time structures are expected to be useful for any dynamic 
linking process. To support class-by-class pre-verification or 
fully lazy loading, type checking must be done without full 
knowledge of the type lattice, most of which is typically 
defined in other modules which may not yet otherwise need 
to be loaded. In particular, the JVM typically needs to find 
a LUB (lowest upper bound) type in the type lattice during 
verification. Thus, there is a need to perform the functions 
that rely on a LUB even when the type lattice is unavailable. 

SUMMARY OF THE INVENTION 

The foregoing and other features, aspects and advantages 
of the present invention will become more apparent from the 
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following detailed description of the present invention when FIG. 7A is a flowchart depicting class-at-a-time pre- 
taken in conjunction with the accompanying drawings. verification for the example class BAR from FIG. 2 accord- 
It is an object of the invention to perform verification 10 tne present invention, 
during Unking while providing for fully lazy loading. It FIG - 78 is a flowchart depicting pre-verification of a 
would be advantageous for a dynamic linker, and in par- 5 method during step 716 of FIG. 7A. 
ticular the JVM, to require that all resolution of referenced FIG. 7C is a flowchart depicting use of class-by-class 
modules (e.g. classes) would be done lazily at specific, pre-verification during step 530 in FIG. 5A, during verifi- 
defined points during execution of instructions (e.g., of a cation at run time of the example class BAR from FIG. 2, 
method). The advantages include: according to one embodiment of the present invention. 
Write once, run anywhere (WORA) characteristics are 10 PIG- ^ is a flowchart depicting use of class-by-class 
improved. The behavior of a program with respect to pre-verification during another embodiment of the present 
linkage errors is the same on all platforms and imple- invention for step 530 from FIG. 5A which allows fully lazy 
mentations. loading with class-by-class pre-verification of the example 

Testability is greatly improved. For example, one need not class BAR from FIG ' 2 * 

anticipate all the places where a class or method might 15 FK5- 9 * a block dia e ram of a computer configured for 

be linked and attempt to catch exceptions at all those pre-verification with a cache for trusted classes and verifi- 

places in case the class or method cannot be found. calioD constraints, according to another embodiment of the 

at-a-time before linking with fully lazy loading and P resent invention. 

reduced verification during linking. ^ NOTATIONS AND NOMENCLATURE 

BRIEF DESCRIPTION OF THE DRAWINGS The detailed descriptions which follow may be presented 

Hie objects, features and advantages of the invention of in term * of program procedures executed on a computer or 

the present invention will be apparent from the following network of computers. TTiese procedural de>cnptioos and 

........ representations are the means used by those skilled in the art 

description in which: t * t a . . ,\ c tU ■ t . 

n J „ A . , 25 to most effectively convey the substance of their work to 

FIG. 1A is a view of an exemplary computer system Qlners [n ^ aft 

suitable for use in carrying out the invention. A procedurc is here> and generallyj to be a 

FIG. IB is a block diagram of an exemplary hardware self-consistent sequence of steps leading to a desired result, 

configuration of the computer of FIG. 1A. stcps are those requirmg physical manipulations of 

FIG. 1C is an illustration of exemplary memory medium 30 physical quantities. Usually, though not necessarily, these 

suitable for storing program and data information in accor- quantities take the form of electrical or magnetic signals 

dance with the invention. capable of being stored, transferred, combined, compared, 

FIG. ID is a block diagram of a network architecture and otherwise manipulated. It proves convenient at times, 

suitable for carrying data and programs in accordance with principally for reasons of common usage, to refer to these 

the invention 35 signals as bits, values, elements, symbols, characters, terms, 

FIG. IE is a block diagram of a computer configured in numbers, or the like. It should be noted, however, that all of 

accordance with the invention these and similar terms are to be associated with the appro- 

FIG. 2 is an example of a class BAR having a method priate physical quantities and are merely convenient labels 

FOO and referencing classes A and B, in the pseudo lan- applied to those quantities. 

guage similar to the JAVA™ programming language. *o Further, the manipulations performed are often referred to 

FIG. 3 is a flowchart depicting fully eager loading of the in terms, such as adding or comparing, which are commonly 

example class BAR from FIG. 2. associated with mental operations performed by a human 

FIG. 4Ais a flowchart depicting almost lazy loading of operator. No such capability, of a human operator is 

the example class BAR from FIG. 2. necessary, or desirable in most cases, in any of the opera- 

FIG. 4B is a flowchart depicting access-type checking 45 tions described herein which form part of the present inven- 

employed in a recent update to the JVM for step 475 of the li °n; the operations are machine operations. Useful 

almost lazy loading depicted in FIG. 4A. machines for performing the operations of the present inven- 

FIG. 5A is a flowchart depicting verification within the < ion include g eneral P ur *> ose di ^ lal com P uters or sunilar 

Unking step 435 of FIG. 4A for the example class BAR of cn devices - 

Pjq 2 present invention also relates to apparatus for per- 

FIG. SB is a flowchart depicting method verification formin g ihts f °(*™«<>™- ™* apparatus may be specially 

during one embodiment of step 530 from FIG. 5A for the constructed for the required purpose or it may comprise a 

example class BAR from FIG. 2. f"" 3 , 1 P u n«» e "^P 1 "" ■« selectively activated or recon- 

■ a . I ... o^ t . . -a figured by a computer program stored in the computer, liie 

FIG. 5C is a flowchart depicting lnstructjotkvenfication^c,- & . j lT • *-u .1 1 ♦ j . 

. t . , ... . v * _ '■; i =;p7*^- , ^--^*'* , ^ S5 procedures presented herein are not inherently related to a 

rWithmsthe venfywinstr^ctioniisteplSSTiot FIG. 5B. .1 . *u . w \- .„ , 

- * ' , % , , ._ particular computer or other apparatus. Various general 

FIG. 6A is a flowchart depicting a method verification ^ machines may 5e used ^ prog rams written in 

during an embodiment of the present invention for step 530 accordance wiln the cachings herein, or it may prove 

from FIG. 5A for the example class BAR from FIG. 2 which convenient t0 ^vOwA more specialized apparatus to per- 

allows fully lazy loading. 60 form , hc required melhod sleps . The required structure for a 

FIG. 6B is a flowchart depicting instruction verification varie(y of tnese machines w ;u appear from the description 

within the verify instruction step 637 of FIG. 6 A, according given, 
to an embodiment of the present invention. 

FIG. 6C is a flowchart depicting verification constraint DES ^ im ^^r^^}^ EFBRR ^ D 

checking according to an embodiment of the present inven- 65 EMBODIMENT 

tion during step 475 of FIG. 4A for the example class BAR FIG. 1A illustrates a computer of a type suitable for 

of FIG. 2. carrying out the invention. Viewed externally in FIG. 1A, a 
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computer system has a central processing unit 100 having produced by the compiler 194 on the server 195, can be 

disk drives 11 OA and 110B. Disk drive indications 110 A and transported across the network 190 and stored as a module, 

HOB are merely symbolic of a number of disk drives which e.g., 156, on one of the client computers, e.g., 100. There the 

might be accommodated by the computer system. Typically, platform specific implementation of the VM, e.g., 150, can 

these would include a floppy disk drive such as 110A, a hard 5 execute the instructions in the module 156. 

disk drive (not shown externally) and a CD ROM or DVD Specifically, the present invention is described using the 

dnve indicated by slot 11 0B. The number and type of drives jyM ^ ^ ^ ^ ^ Ues lQ 

vary, typically, with different computer configurations. The ^ ^ ^ ^ modllles from 

computer has a display 120 upon which information is r . , \_ 0 „ j 1 

j . 1 , A1 . . r + An -( • „„„ nXr . n vanous sources, and which verifies those program modules 

displayed. A keyboard 130 and mouse 140 are typically also 1Q are executed " _ " 

available as input devices. The computer illustrated in FIG. r " 

1A may be a SPARC workstation from Sun Microsystems, As an example of pseudo-source code for a program 

j nc module representing a class thai exhibits the conditions that 

FIG. IB illustrates a block diagram of the internal hard- cause P«*leiw to be solved by the present invention, FIG. 

ware of the computer of FIG. 1A. A bus 150 serves as the 1S * shows pseudo source code wntteQ m , programming 

main information highway interconnecting the other com- language similar to the JAVA™ programming language. The 

ponents of the computer. CPU 155 is the central processing fire < llne «""»» lhe class BAR. ^ firs * ° f f 1 ** 5 

unit of the system, performing calculations and logic opera- «P~n« other statements that contribute to the deflniUon 

lions required to execute programs. Read only memory of class B AR but w.U not be considered here. The next hne 

(160) and random access memory (165) constitute the main „ *™g»> f"> ° <he f xam P le **** » method named 

memory of the computer. Disk controller 170 interfaces one F0 ° "> the class BAR (also denoted as BAR.FOO); the type 

or more disk drives to the system bus 150. These disk drives " v °' d indica,es no value 15 ret " rned when an m ^ oca ' 

may be floppy disk drives, such as 173, internal or external tion ° f lh , e ™ thod F0 ° terminates The next hne introduces 

hard drives, such as 172, or CD ROM or DVD (Digital an lf eke c c™ 51 ™ 1 mat P rovides two branches during 

Video Disks) drives such as 171. A display interface 125 „ execution. If the method argunent, named arg is true, one 

interfaces a display 120 and permits information from the branch is executed, represented by the next set of e hpses, 

bus to be viewed on display. Communications with external assignment statement mside the braces and the following 

devices can occur over communications port 175. e11 '^ ™? assignment statement states that the variable 

FIG. 1C illustrates an exemplary memory medium which n ^ ed ^ T'. h^f SS^Zi^ 

, j • . , . u iii ■ ci/ i D ^iif.A,n of the class B. Thus, in this branch, reference is made to two 

can be used with dnves such as 173 in FIG. IB or UOAin 3 o olherclasseS)ClassAandclassB , the referenced classes. The 

n ™onI? 1C y ' n e T, y v'J ^ ia 'n C t aSa n 0P r,^ 'Z next line, the else of the if else construct, signals the 

a CD-ROM, or a Digital Video D^k, will contain the • Qf ^ q[ ^ £ ^ 

program information for controlling the computer to enable « ^ ^ altemate branch fa 

the computer to perform its functions ,n accordance with the ^ . & represented by anotner ^ of 

invention. 35 ellipses to indicate that no reference is made to either class 

FIG. ID is a block diagram of a network architecture a or B in this branch. The branches converge again at the 

suitable for carrying data and programs in accordance with statement wbere me value of variable z j, signed t0 its 

some aspects of the invention. A network 190 serves to orf . , ya , ue ared _ 

connect a client computer 100 with one or more servers, . , , „.„ . , ... cnn 

such as server 195 for the download of program and data 40 " s «* exam P le class BA ?. and , ,ts m . ethod ™°' ,h . e 

information. A client. 100' can also connect to the network ?f™<* belw f en ^ n *: alraost ^ a " d 

190 via a network service provider, such as ISP 180. The } az V loadlD 8. and < he ad vantages of the present 

elements related to a virtual machine (VM) or other com- f ™ n > can «* f™» * a v f al ™ aolune SU oh as the 

puling architecture implemented in either hardware or soft- ™*- Of course, the JVM does not operate on the JAVA™- 

ware may be distributed across a network as described 45 P^g^ming language hsted 10 . 2 > but °f erates 

below mstead on a module containing mstmctions^ypically gen- 

™ ' . . , , n , tn . t- derated by a compiler; the compiler operated on the high level 

FIG. IE shows a single computer configured to have - J . ■ * , r . * , IVt . . ^ n -> 

& . . r ™r . programming language code such as that listed in MO. 2. 

components related to a virtual machine. The components F B , . , , , J . c , . „ An 

include source code statements 162 in one or more logical RC 3 depicts fully eager loading of example class BAR 

blocks of a memory medium in the computer, a compiler 164 so by a JVM. Assuming class BAR is not already loaded, when 
whictrcompiles the source code 162 to produce one or ■ BokP lhe time coraes 10 invoke a method F0 ° defin ^ d lD class 
modules 165, 166 .containing instructions such ^as^VM^ BAR, in step 310, the JVM loads class BAR from some 
instructions, and a pfocessor ^uch as a virtual machine (VM)' storage device into memory fusing the class loader for BAR, 

167 which takes one or more modules-165, 166 as input and e.g., loader LI. Class BAR is then the current class. Since 

executes the program they^generate^ Though shown on one 55 current class BAR references classes A and B, the eager 

computer in FIG. IE, it should be understood that a module JVM calls the loaders for both those classes as well, if they 

165, and the processor, e.g. the VM 167, need reside, at least are not already loaded, in step 320. In FIG. 3, the class 

temporarily, on the same computer. The module can be sent loaders for classes A and B are designated as L2 and L3, 

from a different computer which runs a compiler to generate respectively; but LI, L2 and U may all be the same built-in 

the module from source code. For example, FIG. ID shows 60 or user-defined class loader, or any two may be the same, or 

a compiler 194 and source code 192 on the server 195 and each may be different. 

two different implementations of the virtual machine 150, During linking 335 verification is performed by the JVM . 

151, one on each of the two clients 100, 100', respectively. Many details on the procedures used during verificauon are 

The source code 192 (and 162 in FIG. IE) can be any described in U.S. Pat. No. 5,740,441 referenced above. As 

language, but is preferably in the JAVA™ language pro- 65 described in that patent, verification includes identifying any 

gramming language, and may be written by a human pro- instruction sequence in a method that attempts to process 

grammer or output from another program. The module 196, data of the wrong type, or any instructions that would cause 
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underflow or overflow of an operand stack of the virtual B. When the first instruction referencing B is encountered, 

machine. Instructions in the JVM are type specific, so the a method of class B must be invoked (the constructor of B), 

operands operated on by the instruction must match the type and the reference to class B must be resolved. The test 

the instruction is defined for. Operand stack overflow is an represented by step 460, asking whether B must be resolved 

attempt to put an item, such as a primitive value or object 5 for this instruction, is answered in the affirmative. Tben.step 

reference, on an operand stack that would cause the stack to <70 '° ads class B, if it is not already loaded, using class 

exceed the preset maximum size for the slack defined in the loader L3. ...... . . , 

class file, i.e. when the stack is already full. Operand stack Io conventional JVM, processing simply continues 

underflow occurs when an instruction attempts to take an where a Post ^± 475 15 shown m mG : **• ™ d T VeS 

item from an operand stack when there are no valid items 10 d^ectly to step 480. Since a new instance of class B is being 

left on the stack, i.e., when the stack is already empty. It is created - « must first te lmked and initialized. So, the next 

anticipated that any validity checks that can be performed *P 15 f° r < *f B ' t0 b , e »> <» * « ^ ° ot ^ 

prior to execution of the iastructions in a module may be been linked. If class B passes linkage (including 

included in verification. venncahon) ,n step 480, then in step 490 class B is nitri- 

.„ . „ j , , ■ . . . ized and then processing continues in step 498, in which the 

If venfication of a module fails, the virtual machine ^ newl esolved class B can be ^ by the current instruc- 

should identify the error and not attempt to execute the t - Qn ' 

instructions in the module. In the case of the JVM, the JVM 1 ^ flQw to be ^ ^ a ^ fa nQ{ 

throws a linkage or verification error message (not shown) PP necded ' ^ a reference ^ 

that can be handled gracefully by class exception handlers. ^ ^ be shown ^ ^ lhe 

If verification of a module succeeds and linking is conventional JVM spec, the verifying step during linking 

complete, execution may begin. In this example case, the 435 might require tne loading of class B. In such a case, the 

current class BAR may be initialized, step 340, and the proce ss cannot be considered fully lazy; and the process is 

method FOO.BAR of the current class is run, step 350, as the caJled almost i azy loading. 

JVM interprets each instruction and executes it. The inter- Qne problem identified during almost lazy loading iUus- 

preter does not need to check types, or operand stack trated Jn nG ^ fe dass name ambiguily . wbeo sever al 

overflow or underflow, because that was already done by m compiled togcther , the compiler generates a name 

verification performed during linking 335. spacc containing class names that are unique within the 

1\vo advantages of the process involving dynamic name space. However, when several classes are compiled at 

linking, described above, are that classes developed and 3Q different times by different compilers, name uniqueness for 

compiled by others can be used safely and that, after linking, a c j ass ca nnot be guaranteed. At run time, class loaders may 

execution is faster. Classes compiled by others can be used introduce multiple name spaces. As a result, a class type 

because they are verified during linking, prior to execution, during run lime is defined not by its name alone but rather 

to prevent invalid, and possibly dangerous operations. by tne co mb ination of the class name and its defining class 

Because type checking and operand stack overflow and 35 i oade r, e gi <BAR,L1>. This circumstance can fool the 

underflow were performed during verification, they are not verifier even in the conventional system where the verifying 

performed upon instruction execution, so that execution step i oads a u referenced classes needed to resolve types, 

times are faster. Similarly, other validity checks performed During Linking 435, including verification, it is assumed 

during verification can be safely skipped at execution, tnat lnc referenced class, e.g. B, has the type that would be 

In lazy loading, as illustrated in FIG. 4 A, a class is not 40 conferred by the current class loader, e.g., LI; that is, the 

loaded until it is needed during execution. The advantage of "type" of class B is assumed to be <BJL1>. If this assump- 

this can be illustrated with the sample class BAR in FIG. 2. tion is not true, then problems of access privileges can arise. 

If arg is false, the assignment referencing classes A and B in For example, if B's class loader L3 is different than BAR's 

the "if branch is never made, and neither A nor B may need class loader LI, and if <B,L3> declares a variable to be 

be loaded or linked. Thus processing is faster at run time 45 private that <B,L1> declares to be public, then VM may 

with lazy loading. allow access to the private variable from outside the class B 

For example, as shown in FIG. 4A, after loading class and program security can be compromised. 

BAR with class loader LI in step 410, classes A and B In the most recent version of the JVM spec, the second 

referenced by BAR are not immediately loaded. Instead, edition, released April, 1999, this problem is avoided as 

class BAR is verified during linking in step 435; and, if class 50 described in another related application, U.S. Ser. No. 

BAR passes verification and linking, the JVM goes on to 09/134,477 Bracha and Liang, entitled METHODS AND 

initialize class BAR in step 440. On the other hand, if class APPARATUS FOR TYPE SAFE, LAZY, USER-DEFINED 

BAR does not pass linking and verification, then an error CLASS LOADING, also referenced above. FIG. 4B shows 

message is thrown (not shown) and execution is not a flowchart illustrating the solution utilized in the second 

attempted (not shown). After class BAR is initialized in step 55 edition of the JVM specification. Using this solution, extra 

440, the main method in class BAR is executed and even- steps are included in the Post Load step 475. The step 473 

tually method FOO is invoked in step 450. If the variable arg determines whether class B, as actually loaded with L3, 

is false, the "else" branch is taken in method FOO and produces the type assumed based on the name and BAR's 

neither class A nor class B is used. This is represented in loader LI; i.e., step 473 determines whether <B,L3> equals 

FIG. 4A by the decision step 460 determining whether the 60 <B,L1>. If loading B actually produces a type different from 

current instruction requires resolving a reference to class B. the type assumed, then class B fails the name/type 

If class B is not required, the current instruction is executed constraint, and an error is thrown in step 474. Otherwise, 

and execution continues with the next instruction looping execution continues in step 479. This process, described in 

back to 460 until no more instructions remain to be verified. the application cited immediately above, does not change 

If, on the other hand, variable arg is true, the "if* branch is 65 the fact that the linking in step 435 might require loading the 

executed. This branch contains the assignment in which the referenced classes A and/or B to check subtyping for their 

variable var of type class A is set to a new instance of class use by class BAR, as described below. Thus the cited patent 
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application does not solve the problems interfering with 
providing fully lazy loading. 

Verification steps within linking 435 of FIG. 4 A are 
illustrated for the example using FIGS. 5A, 5B and 5C. FIG. 
5A is a flowchart that shows that liiikin£ iclass| B^M^tep\ 5 
435 includjcs. sUrting . verification of the current class BAR 
510 followed eventually by a step 530 in which the method 
FOO of current class BAR undergoes verification. 
Subsequently, the verification of class BAR within step 435 
is finished in step 590. The procedures employed during the 10 
conventional embodiment 530a of step 530 to verify method 
FOO of class BAR, are shown in FIG. 5B. The method starts 
in step 532. If the method references other classes such as A 
and B, and which are not yet already loaded, the verify 
process may need to load classes A and/or B. This first ]5 
determination is made for each instruction in step 555. If 
referenced class B is needed, it is then determined whether 
class B is already loaded, step 540. If needed and not already 
loaded, the referenced class is loaded, step 550. Thus, even 
though lazy loading is desired, verification of methods may 2 o 
load other classes before the classes are actually needed 
during execution. As represented by step 537, if an incorrect 
sub typing relation between A and B or other verification 
problem is found during verification, a verification error is 
thrown in step 539. If the current instruction passes 2 5 
verification, the verification process continues to the end of 
the method in step 582 looping back to step 555 until no 
more instructions need to be verified. That is, a sufficient set 
of instructions are verified so that execution of the method 
may begin. 30 

FIG. 5C shows some example details of verification that 
may be performed during step 537; for example, as per- 
formed in the JVM and described in U.S. Pat. No. 5,740,441, 
FIG. 4B. In this example, a type snapshot is maintained for 
each instruction. The type snapshot is a structure which 35 
holds the types for a list of local variables and for each 
position on an operand stack. When an instruction needs to 
be verified, its snapshot is loaded, step 533. In step 534 the 
effect of the execution of the instruction on the types in the 
snapshot is determined. When an instruction is a successor 40 
to multiple other instructions, such as when two branches of 
operations converge (as at the statement involving "z" in the 
example method BAR.FOO in FIG. 2), the type snapshot for 
an instruction must be merged with the snapshots of the 
predecessor instructions on each of the branches. This is 45 
accomplished while verifying an instruction by determining 
the successor instructions to the current instruction in step 
535 and merging the snapshot of the current instruction with 
that of each successor in step 536. This merge will detect a 
verification failure if primitive types at the same locations in 50 
the snapshot don't agree. The merge also replaces references 
at the same position in the merging snapshots with the most 
specific common supertype (also called the lowest upper 
bound, LUB, or the least common supertype, LCS) in the 
resulting merged snapshot; and verification fails if this can 55 
not be done. 

As shown by FIG. 5B, verification of a method that 
references other classes may prevent fully lazy loading 
because the verifier may have to load referenced classes. The 
loading of referenced classes is not assured — it depends 60 
upon the context in which the references are made. In the 
example, A must be a superclass of B for the assignment 
statement to be legal. This subtyping relationship can be 
checked by loading class B. If A is a superclass of B, A 
would have itself been loaded in the process of loading B. 65 
If A is not loaded after loading B, it cannot be a superclass 
B. If A is loaded, one can directly check if the relation holds. 



Verification with Fully Lazy Loading 

To achieve fully lazy loading with verification according 
to the present invention, it must be made possible to delay 
the checking of cross-module relationships that trigger load- 
ing according to conventional practice. 

If, during the verification of example class BAR, B is 
already loaded, one can determine immediately if the sub- 
typing relation holds. The supertype has either been loaded 
when loading B or else it cannot be a supertype of B. If class 
B is not already loaded, according to the present invention, 
a constraint is placed or imposed on class B which will be 
checked or enforced after class B is loaded, if ever. An 
example of this embodiment of the invention is illustrated in 
FIG. 6A through FIG. 6C. 

FIG. 6A is a flowchart for an implementation, 5306, for 
the method verification step 530 shown in FIG. 5Aand is an 
alternative to the version 530fl shown in FIG. 5B for the 
conventional JVM spec. According to this embodiment of 
the present invention, the method verification starts in step 
632 and determines whether information about referenced 
class B of the type that conventionally triggered loading is 
needed, step 655. If referenced class B would conventionally 
trigger loading, the procedure next checks whether refer- 
enced class B is already loaded, step 640. If class B is 
already loaded then processing can continue as in the 
conventional JVM with checking the subtyping and other 
validity checks in step 637, and throwing the error in step 
639 if an instruction fails verification. If the instruction does 
satisfy the validity checks including inter-module checks, 
then verification of method FOO continues, looping through 
suflicient instructions until no more instructions need to be 
verified to begin execution, step 682. If any instruction 
needed to begin execution fails verification, execution of the 
module would not begin. 

However, if it is determined in step 640 that class B is not 
already loaded, the class loader for class B is not called to 
load class B at this time. Instead, verification constraints for 
class BAR's use of class B are written in step 650. Then it 
is assumed all cross-module checks on B, such as subtyping 
checks, are passed, and the verification of method FOO 
continues in step 682 as before. The circumstances that lead 
to writing constraints, and the form of those constraints, in 
step 650, are described in more detail later for the examples. 
According to this embodiment of the present invention, the 
verification step 5306 during linking does not interfere with 
the fully lazy loading of modules, as is desired. 

Verification with Symbolic Computation of LUB 

If a referenced module or class is not yet loaded, it 
remains not loaded during such fully lazy linking. In the 
JVM, this impacts the result of merging snapshots because 
the LUB inserted in step 538, illustrated in FIG. 5C, may not 
be known. Staled another way, the representation of the type 
lattice by the JVM may not be sufficiently populated to 
determine the LUB for the multiple different referenced 
types. FIG. 6B shows how the merge snapshots function is 
accomplished according to one embodiment of the present 
invention. Steps 633, 634, 635 and 636 are analogous to 
corresponding steps 533, 534, 535 and 536. However, in step 
638, if the LUB is not known, its type cannot be inserted into 
the appropriate position of the merged snapshot. Instead, a 
list of referenced types at the appropriate fixed position in 
the snapshots of the predecessor instructions is inserted or 
otherwise associated with that fixed position in the merged 
snapshot. That is, instead of identifying and placing the 
reference to a LUB in the snapshot at this location by 
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loading classes or modules as necessary to construct the type 
lattice, the several references to different types, e.g., class 
types X 3 , X 2 , . . • , X„, that cause the need for an LUB, are 
listed symbolically, perhaps separated by a sign or symbol 
such as a *. The symbol indicates the types must share this 5 
relationship of having an LUB. 

Constraint Enforcement 

The constraints written or otherwise recorded for use by 
the VM in steps 650 are enforced, e.g. checked, when and if 10 
referenced class B is actually loaded. Thus, the constraints 
are enforced immediately after loading during the Post Load 
step represented by step 475 in FIG. 4A. FIG. 6C illustrates 
the enforcement of verification constraints on referenced 
class B according to an example embodiment of the present 15 
invention. This embodiment of the invention represents a 
new process 475ft that may include the steps of 475a 
illustrated in FIG. 4B. The enforcement begins at step 671. 
In the examples, the actual supertypes of B are used to 
determine whether B satisfies the subtyping verification 20 
constraints previously written. This check is made in step 
673. If the referenced class B does not satisfy the constraints, 
then an error is thrown in step 674. The handler for this error 
may then terminate execution or allow execution to con- 
tinue. Alternatively, execution may be terminated without 25 
throwing an error. If the referenced class B does satisfy the 
written constraints, then Post Load processing finishes in 
step 679. 

With such modifications, a VM can implement fully lazy 3Q 
loading with verification. The advantages of imposing fully 
lazy loading include: 

The behavior of a program with respect to linkage errors 
is the same on all platforms and implementations. 

One need not anticipate all the places where a class or 35 
method might be linked and attempt to catch exceptions 
at all those places. 

Users can determine the availability of classes or other 
modules in a reliable and simple way. 

One of the advantages of the present invention is that a 40 
programmer can test for the availability of classes on a 
platform in a reliable and simple way. For example, if a 
programmer wishes to use modules of a newer release and 
use those newer modules only if they arc available, then lazy 
linking makes that easier. Somewhere in the code produced 45 
by the programmer in this case will be a branch with a 
reference to the new modules of the new release. Execution 
of that branch would be designed by the programmer to not 
occur if the current version of the platform does not support 
the modules referenced in that branch. If the new module is so 
not available on that platform, and the module being verified 
references the new module, a virtual machine which is not 
fully lazy may require the verifier to attempt to load the 
missing new module. This loading will necessarily fail, 
which will lead to failure of the verification step. Thus, 55 
verification will cause a failure due to a missing module 
even though the module is only referenced in a branch that 
would never be executed. With fully lazy loading required, 
verification will not fail due to modules referenced by 
instructions not actually executed. This ability to pass veri- 60 
fication while checking for the latest releases of modules, 
such as classes, provides a significant motivation for adopt- 
ing fully lazy loading, supported by the present invention, as 
a requirement of a virtual machine. 

Even with required lazy loading, different implemenla- 65 
tions of a VM could be free to load and link earlier — 
provided that any failures manifest themselves only at the 



legal, defined points. The code must be able to execute up to 
the point when the class with the faulty type must be 
resolved. For example, a just-in-time (JIT) code generator 
may choose to pre link a class or method as it compiles it. 
However, if any of the linking fails, rather than failing 
immediately, the JIT should generate code that will cause the 
appropriate exception to be raised at the point lazy loading 
would have otherwise done so (it need not actually do the 
link time tests, though it can). As another example, a static 
compiler can fail during its proprietary link phase due to an 
invalid class reference. If, nonetheless, it chooses to compile 
code even though it cannot be completely linked, that code 
must fail when executed at the same point as would code 
complied by the JIT. As a final example, when dynamically 
loading a class (e.g., through a class loader), an implemen- 
tation may choose to prelink it, wholly or partially. However, 
if there are any failures, the code must again be able to 
execute up to the point of the invalid reference. 

Module-by-Module Verification 

In another aspect of the present invention, verification of 
a referenced module is not performed even if a referenced 
module is loaded. l^i^SS^^i^l&?^H^ m 9^ u ^ e 
verification, also called one-raodule(class)-at-a-time. 
verification; is desirable for a number of reasons. It allows 
verification to be performed before run time with beneficial 
consequences. The run time costs of verification in time and 
space can be reduced or removed altogether. Redundant or 
run-by-run verification can be obviated. The JAVA™ runt- 
ime environment can be smaller and simpler because the 
amount of code implementing verification it contains can be 
reduced. This one-module-at-a-time verification, imple- 
roented as an extension to the JAVA™ platform as class- 
by : class verification, is not automatically provided by either 
the conventional JVM specification, or the proposed fully 
lazy loading described above. In the first case, the verifier 
automatically loads referenced classes if needed with no 
option to avoid doing so. In the latter case, verification of the 
referenced class will occur if the referenced class is loaded 
and this verification is also performed with no option to 
avoid doing so. Thus, two embodiments of class-by-class 
verification are anticipated, one that can be used with the 
conventional JVM design and one that can be used with the 
new fully lazy loading design. 

According to one embodiment of this invention, the 
checks usually performed during verification may be per- 
formed before run time. Because checks before run time are 
technically not part of linking and thus not part of the 
verification stage of linking, these checks are herein desig- 
nated pre-verification, indiLeating^potentially pre-run time 
ehejEte»qfmyalidity^ 

In this embodiment, any time after a binary class has been 
generated by a compiler, the programmer can perform 
pre-verification on the binary class, and do so independently 
of any other classes that might be referenced in that class. As 
a consequence, access to a referenced class or referenced 
module is not required. This class-by-class pre-verification 
of the present invention is illustrated in FIG. 7A. The 
method begins, for example, with loading the class BAR 
from a storage medium into memory, step 710. Then in step 
7 12 ^t he ^ a l id^y checks are made, such as«type checks and 
operanaL^stack o verfl5w/u nderflow checks, that would con- 
ventionally be made during verification. During such 
checks, any inter-module information needed for verifica- 
tion of ^instructions referencing other modules, such as 
subtyping relationships between classes A and B referenced 
from class BAR, is optimistically assumed so that instruc- 
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tions are valid. However, the assumed information or rela- a referenced class is loaded; either an intra-module check is 
tionship places a constraint on the referenced module that made or a pre-verification constraint is written. No cross- 
must be remembered by the virtual machine. Such con- module checking is performed even with a module that is 
straints must be checked if such a referenced module is already loaded. 

ultimately loaded. If, in spite of these assumptions, the 5 nG 7C shows how a module> which nas beell verified 

module such as class BAR does pot pass the checks one . m odule-at-a-time before run time, is handled by the 

performed, an error results, step 713 As such an error ,s not verification performed during lmking at ran time , for the 

necessarily a runtime error, it m.ght not be thrown to a ^ BAR £ ^ ^ q{ |he 

handler during execuion^ Instead, such an error might have C0Qve P ntional Qr the F modified step 5304, f or fully lazy 

to be commune, ed to the programmer, for example using J0 • £ ^ ^ 

an error message that appears on an output device such as a , & ' r . rt , 

_i • 1 ir.u ^1 . 0 „„ t L 0 A u( ,i, r the almost lazy loading of the conventional JVM and 

printer or display screen. If the module passes all the checks, . • u i , Aft „ e . f , r#1 -„ 

f. c « ■ . • * , u ,1 «. „,„-, incorporates classrby^lass pre-verification. After starting 

then any pre-verification constraints to be recalled are wnl- - v . --- - J t * r ~ . „ 

, , , # , ( . c l he venfication step for instructions of a module, such as 

ten in step 716 for later use at run time. Subsequently, the dad • ♦ 7(n „ , t - • 

^ « ft . -c . • i . method FOO of class BAR, in step 792, a determination is 

process stops at step 719 when pre- verification ls complete. 1C ^ , , i- ji u j •« • 

1 . / V A , 1 . . fi 15 ma de whether the module has passed pre-verification in step 

Another class or module can then be pre-venfied following _ OA t in . . „ ., M t:™i i\r\A 

.u * -ii . ♦ a - cii- iA m„, ;«i„,^; rtn o in ! 780. If not, control follows the now of the conventional JVM 

the steps illustrated in FIG. 7A. Not all the instructions in a 9 . _ D _ , . ft „.-,,„ 

• i a . ur -a a > ~, .u- starting at step 555 in FIG. 5B. Otherwise, after optionally 

module may nwd to be-pre-venfied, jus. the mstruc tons * P pre-verified module is to be trusted in 

needed for a particular use of the module. For example it ?8 | control flows to ste 784 . 

may be necessary only to verify the instructions in method n r . ' . ,. fl „ tfn , . „L,u r 

™^ i "~ l uj- i dao 20 ^Avanety of ways are known m the art for testing whether 

FOO, but not other methods in class BAR. a fifc . & ^ ^ ^ a ^ , f 

Optionally, the pre-verification constraints can be written ^ ^ ^ about ^ t^orthiness of pre .verified 

to a file or otherwise assoc.ated with the module for check- modules sl 783 „,„ be sldpped . At slep 784> ^und of 

ing later, at run time. For use with the JVM, these constraints . th . ^ instruclions in the method> the ^ 

could be recorded as data associated with the class in the 25 vef . fier reads ^ erification constraints recorded/ 

binary class format on the storage medium. When the class w[iaea d . the class . byK:lass verification of BAR. If 

is loaded into memory, these constraints could be internal- ^ wfire nQ e . verification constraints written, verifica- 

ized by the JVM for checking when it becomes necessary, ^ q( bar foo is comp i eted and c^i goes to step 778 

for example, after loading of the referenced class B. (o wfap up ^ process 

As a further option, according to this invention, the 30 , f verificalion constraint was writt en for a refer- 

pre-venficat.on constraints however stored^r the module module, e.g., classes A or B, then the run time verifier 

itself, or both can have attached a signal, such a^ d^.ta ^^.^ » r ^ refcrcnced m(jdule fa (he constrainl 

.signature that can be used to rehably .dent.fy the source of pre-verification 

the module or constraints and indicate whether they may ^ enforced £ m , f {be modu , e 

have been tampered with since being signed. 35 faUs the constraint, an error is thrown for catching by an 

In this manner, intra-module verification checks of vahd- errof handler) ?62 0lhefwise goes l0 ste p 778 

ity tantamount to those performed during conventional which . mrough ^ pre . verificalion constraints until 

verification, but not requiring cross-module information none remajn , f> in ?g6j u ^ delermined mat the 

about referenced modules such as classes A and B, can be refer6n ced module, such as a referenced class, is not loaded, 

performed prior to runtime. That is, substantially complete 40 lhen , he referenced modu ie, such as a class, is loaded in step 

module-by-module pre-verification can be performed for the n ^ and {he mnslninl ^ en f 0 rced in step 788. 

intra-module checks. Inter-module checks are turned into . . .. 

.„ .. ... So lone as the class has been pre-venned (and optionally, 

pre-venfication constraints. 5 . , . , , r . c . ■ , 

-t. •,. j . 1 c . ci/- e passes trust checks), whether pre-verification constraints 

FIG. 7B illustrates details of step 716 from FIG. 7A for v ", . K nr nn . ,•„,„ -i-c. 

, _, . r - a ■ , were wntten on a referenced class or not, no intra-class 

the example case. The process starts pre-verincation 01 a 45 , ... . . . j.,„-„„ 

u j r . j j 1 n»n . vr ^ •. • j . checks need be performed; they were already done during 
method of a loaded class BAR, step 732. Next it is deter- class . by ^ las P s pre.verificalion before run time. Accord- 
mined whether the next instniction in the method requires lhe present invention, then, after a module passes 
information from a referenced class B ir i order for the J^^.^ pre-verification, run time verification 
instruction ito have ^ts validity checked step 755 .If not then ^ ^.^^ checks it onl enforccs 
the procedure performs any required intra-class validity 50 v 
checks on the instruction in step 737. If the instruction fails *Kr-module constraints. 

the intra^lass check, an error message is written to an output ^ ^ example described, a module is pre-venfied as soon 

device. The programmer may then deal with this problem. If, as it is compiled, without loading any other module. Ihis 

on the other hand, a referenced class would have to be allows for much of venfication to be done before-run time 

loaded to fully verify this instruction, a pre-verification 55 and not repeated every time a module is loaded and linked, 

constraint is written or otherwise recorded in step 750 for thus saving valuable time and space resources (e.g. on 

later recall, and the subtyping relation required by the processors running the virtual machine), 

instruction js^assumcd valid^ Sincc the instruction may also M odule-by-Module Pre-Verification with Fully 

require intra-class checks, control goes to step 737 to ' ^ Loading 

perform those. If the instruction needs no intra-class checks, 60 

then it automatically "passes" the checks at step 737. If the FIG. 8 depicts a flowchart that incorporates the results of 

instruction is found valid after an intra-class check and/or pre-verification during fully lazy loading at run time. FIG. 8 

assumed valid after writing a pre-verification constraint, shows hpw^a rnbdule^ which has been verified one-module-^ 

flow control shifts to step 782 which loops to step 755 until 'at-a=timelbef6re run tiroes is handled by the verification 

no more instructions remain in the method FOO of the 65 performed during linking that supports fully lazy loading, 

loaded class BAR, at which time pre-verification of method for the example class BAR. In place of either step 530a of 

FOO is finished. Note that no determination is made whether the conventional JVM, or the modified step 530& for fully 
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lazy loading, or the step 530c for almost lazy loading with 
one-module-at-a-time verification, FIG. 8 shows an alternate 
step 530</ that follows the fully lazy loading of a new 
embodiment of the JVM and incorporates class-by-class 
pre-verification. Steps 892, 880, 883, 884, 878, 886 and 862 
in FIG. 8 are analogous to steps with corresponding seven 
hundred numbers in FIG. 7C, 792, 780, 783, 784, 778, 786 
and 762, respectively. After starting the verification step for 
instructions of a module, such as method FOO of class BAR, 
in step 892, a determination is made whether the module has 
passed pre-verification in step 880. If not, control follows 
the flow of the fully lazy loading JVM starting at step 655 
in FIG. 6A. After optionally checking whether the pre- 
verified module is to be trusted in step 883, described above, 
control flows to step 884. At step 884, instead of stepping 
through the instructions in the method, the run time verifier 
reads the pre-verification constraints written during the 
class-by-class verification of BAR. If there were no pre- 
verification constraints written, verification of BAR. FOO is 
completed and control goes to step 878 to wrap up the 
process. 

If a pre-verification constraint is read for a referenced 
module, e.g., classes A or B, then the run time verifier 
determines whether the referenced module in the constraint 
is already loaded, step 886. If it is, the pre-verification 
constraint is enforced in step 888. If the referenced module 
fails the constraint, an error is thrown for catching by an 
error handler, step 862. If the referenced module passes the 
constraint without qualification, flow goes to step 878 which 
loops through the pre-verification constraints until none 
remain. 

The remaining steps in FIG. 8 for fully lazy loading differ 
substantially from their counterparts for almost lazy loading. 
If, in step 886, it is determined that the referenced module, 
such as a referenced class, is not loaded, then the referenced 
module is not loaded. Instead, the pre-verification constraint 
is copied to, or otherwise retained in, a memory or storage 
medium, step 889, to be enforced when the not yet loaded 
module, such as a class, is loaded, if ever. 

In FIG. 8, the enforcing of step 888 may have three 
results. Besides failure and passing without condition, it is 
possible that the already loaded referenced module can pass 
only if the contents of one or more other not yet loaded 
modules are known. This result can be considered as "pass- 
ing subject to a condition" that the pre-verification constraint 
on several referenced modules be re-written as a verification 
constraint on the not yet loaded referenced module or 
modules. Step 885 rewrites the pre-verification constraint as 
a verification constraint only on the not yet loaded refer- 
enced modules, such as classes. After the rewrite, if needed, 
control goes to step 878. 

Module-by-Module Verification of Untrusted 
Classes 

As mentioned above, verification according to the present 
invention relies on the ability to construct and annotate a 
module with constraints that must be satisfied by referenced 
modules. Unfortunately, the procedures do not always pre- 
vent an attacker from spoofing such annotations — possibly 
making a malignant class appear benign. Therefore, the 
optional trusted check is included in FIG. 7C at step 783 and 
in FIG. 8 at step 883 according to one embodiment of the 
present invention. Absent these checks, pre-verification can 
be used in trusted situations, for instance where the classes 
can be pre-verified and loaded into a trusted (tamper proof) 
database prior to execution. 
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In untrusted situations, however, more protection is 
needed. According to an embodiment of the present 
invention, a cache is created as shown in FIG. 9. The cache 
920 would contain trusted modules, such as trusted classes 

5 and/or pre-verification constraints, e.g. 965a. Modules and/ 
or constraints imported to a virtual machine from an 
untrusted source, for example a source on the Internet, 
would be placed outside the cache, e.g., at 965. Any pre- 
verification constraints coming with the class from the 
untrusted source, e.g. 965, would be ignored. Instead, the 

10 first time such a module is loaded it is eagerly pre-verified 
in a pre-verifier 910 according to the method depicted in 
FIG. 7 A. If the module fails pre-verification, it will be 
rejected immediately. If the module does not fail pre- 
verification, new pre-verification constraints are generated 

15 as needed and the module annotated, or associated with, the 
new constraints, e.g. 965a, is then stored in a trusted module 
cache 920. On subsequent attempts to load the module from 
an untrusted source, the module cache 920 will be searched 
first. If the cached, pre-verified module 965a is found, the 

20 module 965a can then be safely used as pre-verified. With 
this modification, checking of class-by-class pre-verification 
constraints as shown FIG. 7B will proceed correctly. In 
effect, step 780 of FIG. 7C answers the question about 
whether pre-verification has been performed by checking the 

25 module cache. With this modification, the digital signing of 
the pre-verification constraints, step 718 in FIG. 7 A, is not 
needed. Similarly, with this modification the check of 
whether the pre-verification output is trusted shown in step 
783 of FIG. 7C and 883 of FIG. 8 is also not needed, and 

30 flow proceeds directly from step 780 or 880 to step 784 or 
884, respectively. 

Forms of Constraints 
The methods illustrated in flowcharts in FIGS. 6A, 6C, 

35 7 A, 7B and 8 all provide elements for checking referenced 
classes as late as possible. The form of the constraints 
written, and the manner in which those constraints are 
subsequently checked is as follows. The constraints may be 
written, for example, in step 650 of FIG. 6 A, step 750 of 

40 FIG. 7B, and steps 885 and 889 of FIG. 8. Enforcing of the 
constraints can be applied in step 673 of FIG. 6C and step 
788 of FIG. 7C and step 888 of FIG. 8. 

Constraint generation and constraint checking will be 
described in more detail by example. Referring to FIG. 2, the 

45 assignment statement states that a new instance of class B 
will be stored in the variable var of class type A. In an object 
oriented language, this assignment requires that B be a 
subtype of class A, as represented by the expression B<«A. 
This is not known during verification of BAR unless B is 

50 loaded at that time. If B is loaded and B is a subclass of A, 
then A must also be loaded (because A had to be loaded to 
load B). ITierefore, the conlrapositive is true, that is, if B is 
loaded and A is not loaded, then B is not a subclass of A; the 
assignment statement causes a subtyping mismatch which 

55 causes class BAR to fail verification. If both A and B are 
loaded, as in eager loading shown in FIG. 3, then the 
indicator of the superclass for B can be traced to see if A is 
somewhere a superclass of B. If so, B is a subclass of A and 
this assignment passes verification. If A is not found by 

60 following the superclass indicators up the hierarchy, then B 
is not a subclass of A; the assignment statement causes a 
subtyping mismatch, and class BAR fails verification. 

Using the conventional JVM specification, if class B was 
not loaded already, the verifier would load class B and check 

65 its type, specifically whether it is a subtype of class A. 
According to the present invention, in order to achieve 
fully lazy loading, or class-by-class verification, or both, it 
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is desired not to load class B. Therefore, according to this 
embodiment of the present invention, B is not loaded; and, 
instead, a constraint B<«A is written. This constraint can be 
written in any of the steps listed above for writing con- 
straints (e.g. 650, 750, 889, 885). Later when BAR.FOO is 
executed, if this branch with the assignment statement is not 
executed, and B is not likewise referenced from any other 
instruction that is executed, class B is never loaded. But if 
the branch including this assignment statement is executed 
and B is not yet loaded, class B will be loaded at that time; 
and, at that time, after class B is loaded, the check will be 
made whether class B satisfies the constraint B<»A. This 
checking can be performed, as, for example, in the steps 
listed above for checking constraints (e.g. 673, 788, 888). 
This will be easy to do because if class B is indeed a subclass 
of class A, and inherits its attributes from class A, then class 
A would have to have been loaded already. Thus a constraint 
of this type allows fully lazy loading, class-by-class pre- 
verification, or both. 

There is another check on class type of non-local classes 
that may be treated differently in class-by-class pre- 
verification than it is treated in the fully lazy loading 
implementation, according to the present invention. This is 
the receiver access check for protected members: 

In the JAVA™ virtual machine, a protected member R 
may be accessed by a class or interface D if and only if: 

1. D is in the same run time package as the class C that 
declared R OR BOTH 

2. D is a subclass of C, the class that declared R, AND 

3. if R is an instance member, then T, the static type of the 
instance R being accessed, is a subtype of D. 

Requirement 3. is known as the receiver protected check. 

In a conventional JAVA™ virtual machine, the first two 
requirements are checked when the reference from D to R is 
resolved during linking of D, while the third requirement is 
checked during verification of D. During verification, the 
class C that declares R may not have been loaded yet. In this 
case, it is evident that C is not a superclass of D (otherwise, 
C would per force have been loaded, because loading a class 
implies the loading of all its superclasses). In that case, the 
access is only legal if C and D are in the same run time 
package. The verifier can optimistically assume that this 
holds. The requirement will be checked when the reference 
is resolved. Hence, the verifier only needs to perform the 
protected receiver check if C has already been loaded. In this 
situation, it is possible to determine whether R is a protected 
member at all. If R is not protected, no protected receiver 
check is necessary. If R is protected, the verifier can test to 
see whether D is in the same run time package as C. If this 
is the case, the access is legal and again, no protected 
receiver check is needed. If D and C are not in the same run 
time package, the verifier can check whether D is subclass 
of C and whether T, the static type of the instance being 
accessed, is a subtype of D. If not, an error is raised. Note 
that the check T<=D may require loading of T if it has not 
already been loaded. 

In verification with fully lazy loading, when verifying D, 
its superclass is assumed to have been loaded. Control 
proceeds in the same manner as in the non-lazy case, with 
one exception. If it is determined that a check if T<=>D is 
needed, and T is not loaded, loading must be avoided. 
Instead, the loading constraint T<=D is imposed on T. 

In class-by-class verification, the situation is different. 
Neither the superclass of D nor the class C that declared R 
have been loaded. Therefore, the protected receiver check 
can not be performed. The assumption that if C is a super- 
class of D, it must have been loaded cannot be made, hence 
the declaration of R cannot be examined. It follows that it 
cannot even be determined whether R is protected or not. 
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Instead, appropriate constraints must be generated that will 
be checked at a later time, when the program executes. This 
problem can be solved by generating the conditional con- 
straint: 

5 If(D<-X} then {if(X.m protected) then {T<=D} else 
{true}} else {true} for every instruction of the form: 
invoke o, X.m, 
where o has type T. A similar strategy applies to field 
references. This constraint is examined prior to the initial - 

30 ization of D. At that point, D<«X can be decided (since D 
and all its superclasses have already been loaded). If D<«X 
is not true, no further action is necessary. If D is not a 
subclass of X, then D cannot possibly be a subclass of C, the 
class that declared m. The reason is that C must necessarily 
be a superclass of X. It follows that the reference to X.m is 
only legal if either m is not protected or C is in the same run 
time package as D. This will be checked when the reference 
to X.m is resolved. If it is true that D<-X, then it can be 
checked whether X.m is protected or not. If X.m is not 

2Q protected, the protected receiver check need not be done. 
Otherwise, the test if T<=D can be made which, as above, 
may cause T to be loaded. 

When combining fully lazy verification with class by 
class verification, the procedure for class-by-class verifica- 
tion is followed, except that when evaluating the conditional 

25 constraint: 

if(D<=X) then {if(X.m protected) then {T<-D} else 
{true}} else {true} if one must evaluate T<=D and if T 
is not loaded, one should impose the loading constraint 
T<=D on T, as in the lazy case. 
30 Another constraint is appropriate when verification exam- 
ines the state of the operand stack at a statement that is a 
successor statement to several prior executed statements, 
i.e., where two or more branches converge. At this point, the 
verification is currently designed to merge the snapshots of 
35 the operand slack and local variables from the preceding 
instructions to which the current instruction is a successor. 
If the references are to types defined in classes that are not 
yet loaded, which will always be the case in class-by-class 
pre-verification and sometimes the case in fully lazy 
40 loading, the type lattice is not available and the LUB is not 
known. Following the symbolic representation of an LUB 
described above for step 638 of FIG. 6B, a constraint such 
as "the LUB<=class T' can be replaced by a constraint on 
a list represented symbolically as: 
45 X/X 2 A . . . X„<=T 

This can be factored out into a series of constraints on 
individual classes X t as follows: 
X^-T, X 2 <«T, . . . X„<=T. 

When the current method of a loaded class is executed and 
50 goes through a branch that requires resolution of class X 2 , 
for example, then class Xz is loaded and the constraint 
X 2 <=T can be checked at that time. Alternatively, a con- 
straint on the list can be rewritten dropping X2 from the list, 
if X 2 passes the check when X 2 is loaded. 

As described above, the constraints are written during any 
of several steps (e.g. 650, 750, 889, 885) and the constraints 
are then checked at any of the several checking steps (e.g. 
673, 788, 888). 

With this symbolic representation of the LUB, the actual 
computations may take longer to converge. However, the 
60 process is guaranteed to converge because the constant pool 
of a class file of the JVM is finite. Hence, only a finite 
number of types can be referenced by a method, directly or 
indirectly. As a result, the symbolic representation of an 
LUB must be a finite sequence of class names . . . ~X„. 
65 In turn, this means that the number of iterations through the 
type inference algorithm is finite for the JVM, since itera- 
tions continue until no new types can be added to the LUB. 
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Conclusion of Detailed Description 

Although the present invention has been described and 
illustrated in detail, it is clearly understood that the same is 
by way of illustration and example only and is not to be 
taken by way of limitation, the spirit and scope of the present 5 
invention being limited only by the terms of the appended 
claims. 

What is claimed is: 

1. A method for verifying instructions of a module of a 
computer program during linking, the method comprising: 10 

determining whether a first module which is loaded has 
passed pre-verification one-rnodule-at-a-time; 

reading a pre-verification constraint on a constrained 
module, if any, if the first module has passed pre- 
verification; 15 

determining whether the constrained module is loaded, if 
any pre-verification constraint is read; and 

retaining the pre-verification constraint as a verification 
constraint, if the constrained module is not loaded. 

2. The method of claim 1, further comprising, after said 20 
retaining, returning to reading a pre-verification constraint 
on a constrained module until all pre-verification constraints 
are read. 

3. A computer program product for verifying instructions 

of a module of a computer program during linking, the 2 s 

computer program product comprising: 
a computer readable storage medium; 
computer controlling commands, stored on the computer 
readable storage medium, for determining whether a 
first module which is loaded has passed pre-verification 30 
one-module -at-a-time, for reading a pre-verification 
constraint on a constrained module, if any, if the first 
module has passed pre-verification, for determining if 
the constrained module is loaded if any pre-verification 
constraint is read, and for retaining the pre-verification 
constraint as a verification constraint if the constrained 
module is not loaded. 

4. The computer program product of claim 3, further 
comprising computer controlling commands, stored on the 
computer readable storage medium, for returning to reading 

a pre-verification constraint on a constrained module after 40 
said retaining, until all pre-verification constraints are read. 

5. A verification apparatus for verifying a module during 
linking, the apparatus comprising: 

a computer readable storage medium for storing a module 
of a computer program; 45 

a memory into which a module is loaded; 

a processor configured to determine whether a first mod- 
ule which is loaded has passed pre-verification one- 
module-at-a-time, to read a pre-verification constraint 
on a constrained module, if any, if the first module has 50 
passed pre-verification, to determine if the constrained 
module is loaded if any pre-verification constraint is 
read, and to retain the pre-verification constraint as a 
verification constraint if the constrained module is not 
loaded. 55 

6. The verification apparatus of claim 5, wherein the 
processor is further configured to return to reading a pre- 
verification constraint on a constrained module after said 
retaining, until all pre-verification constraints are read. 

7. A signal transmission comprising: 

a carrier wave on a communications line; and 60 
signals indicative of computer controlling commands, 
transmitted using the carrier wave, for determining 
whether a first module which is loaded has passed 
pre-verification one-module-at-a-time, for reading a 
pre-verification constraint on a constrained module, if 65 
any, if the first module has passed pre-verification, for 
determining if the constrained module is loaded if any 
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pre-verification constraint is read, and for retaining the 
pre-verification constraint as a verification constraint if 
the constrained module is not loaded. 

8. The signal transmission of claim 7, further comprising 
computer controlling commands, transmitted using the car- 
rier wave, for returning to reading a pre-verification con- 
straint on a constrained module after said retaining, until all 
pre-verification constraints are read. 

9. A pre-verification system comprising: 
a network; 

a computer readable storage medium connected to the 
network for storing a module of a computer program; 

a memory connected to the network into which a module 
is loaded; 

a processor connected to the network, configured to 
determine whether, checking an instruction in a first 
module requires information in a referenced module 
different than the first module, and to write a constraint 
for the referenced module without requiring access to 
the referenced module if the information is required, 
whereby pre-verification is performed one-module-at- 
a-time; and 

a processor connected to the network configured to deter- 
mine during linking whether a first module which is 
loaded has passed pre-verification one-module-at-a- 
time, to read a pre-verification constraint on a con- 
strained module, if any, if the first module has passed 
pre-verification, to determine if the constrained module 
is loaded if any pre-verification constraint is read, and 
to retain the pre-verification constraint as a verification 
constraint if the constrained module is not already 
loaded, 

whereby verification is performed one-module-at-a-time 
with fully lazy loading and reduced verification during 
linking. 

10. The method of claim 1, further comprising 
enforcing the pre-verification constraint for cross-module 

checks, if any, involving only loaded modules, if the 
constrained module is loaded; and 
writing a verification constraint for cross-module checks 
of the pre-verification constraint, if any, wherein the 
cross-module checks involve a not yet loaded module, 
if the constrained module passes. 

11. The computer program product of claim 3, further 
comprising computer controlling commands, stored on the 
computer readable storage medium, for enforcing the pre- 
verification constraint for cross-module checks, if any, 
involving only loaded modules if the constrained module is 
loaded, and for writing a verification constraint for cross- 
module checks of the pre-verification constraint, if any, 
wherein the cross-module checks involve a not yet loaded 
module, if the constrained module passes. 

12. The verification apparatus of claim 5, wherein the 
processor is further configured to enforce the pre- 
verification constraint for cross-module checks, if any, 
involving only loaded modules if the constrained module is 
loaded, and to write a verification constraint for cross- 
module checks of the pre-verification constraint, if any, 
wherein the cross-module checks involve a not yet loaded 
module if the constrained module passes. 

13. The signal transmission of claim 7, further comprising 
computer controlling commands, transmitted using the car- 
rier wave, for enforcing the pre-verification constraint for 
cross-module checks, if any, involving only loaded modules 
if the constrained module is loaded, and for writing a 
verification constraint for cross-module checks of the pre- 
verification constraint, if any, wherein the cross-module 
checks involve a not yet loaded module if the constrained 
module passes. 

***** 
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